Skip to content

max_load_factor{?f}#81

Draft
l0rinc wants to merge 18 commits intomasterfrom
detached138
Draft

max_load_factor{?f}#81
l0rinc wants to merge 18 commits intomasterfrom
detached138

Conversation

@l0rinc
Copy link
Copy Markdown
Owner

@l0rinc l0rinc commented Dec 26, 2025

image
for DBCACHE in 450; do   COMMITS="8cdc5dd73b73f60113b4b87ac8a1af5de6bc2ea4 96523d17f02517dc55c88ecef112a59d0f1269dc cbc6318ce8b4b69286f6dfc6c342ad7f319111e7 83aa5806b72ad1e7f433944b01f6afd3006bcec0 830f56fe1fec7396a6fe050f752dd23011ccff0e fd902d065702b3a6ce0db96765b6e7bf36239488 aa58228e27398b6384bcb8176004ae06419d7e00 080fab38c24b7144edc44724adb8aa570f03c728 a099ad79627487518e561f5788c5759014f45301";   STOP=930039;   BASE_DIR="/mnt/my_storage"; DATA_DIR="$BASE_DIR/BitcoinData"; LOG_DIR="$BASE_DIR/logs";   (echo ""; for c in $COMMITS; do git fetch -q origin $c && git log -1 --pretty='%h %s' $c || exit 1; done) &&   (echo "" && echo "reindex-chainstate | ${STOP} blocks | dbcache ${DBCACHE} | $(hostname) | $(uname -m) | $(lscpu | grep 'Model name' | head -1 | cut -d: -f2 | xargs) | $(nproc) cores | $(free -h | awk '/^Mem:/{print $2}') RAM | SSD"; echo "") &&  hyperfine     --sort command     --runs 1     --export-json "$BASE_DIR/rdx-$(sed -E 's/(\w{8})\w+ ?/\1-/g;s/-$//'<<<"$COMMITS")-$STOP-$DBCACHE-$CC.json"     --parameter-list COMMIT ${COMMITS// /,}     --prepare "killall -9 bitcoind 2>/dev/null; rm -f $DATA_DIR/debug.log; git clean -fxd; git reset --hard {COMMIT} && \
      cmake -B build -G Ninja -DCMAKE_BUILD_TYPE=Release -DENABLE_IPC=OFF && ninja -C build bitcoind -j2 && \
      ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=1000 -printtoconsole=0; sleep 20; rm -f $DATA_DIR/debug.log"     --conclude "killall bitcoind || true; sleep 5; grep -q 'height=0' $DATA_DIR/debug.log && grep -q 'Disabling script verification at block #1' $DATA_DIR/debug.log && grep -q 'height=$STOP' $DATA_DIR/debug.log; \
                cp $DATA_DIR/debug.log $LOG_DIR/debug-{COMMIT}-$(date +%s).log"     "COMPILER=$CC ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=$DBCACHE -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0"; done

8cdc5dd73b validation: fetch inputs on parallel threads
96523d17f0 coins: preserve max load factor during cache reset
cbc6318ce8 max_load_factor{2.0f}
83aa5806b7 max_load_factor{1.75f}
830f56fe1f max_load_factor{1.5f}
fd902d0657 max_load_factor{1.25f}
aa58228e27 max_load_factor{1.0f}
080fab38c2 max_load_factor{0.75f}
a099ad7962 max_load_factor{0.5f}

reindex-chainstate | 930039 blocks | dbcache 450 | i9-ssd | x86_64 | Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz | 16 cores | 62Gi RAM | SSD

Benchmark 1: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 8cdc5dd73b73f60113b4b87ac8a1af5de6bc2ea4)
  Time (abs ≡):        17244.638 s               [User: 46827.358 s, System: 2205.419 s]

Benchmark 2: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 96523d17f02517dc55c88ecef112a59d0f1269dc)
  Time (abs ≡):        17397.140 s               [User: 46715.937 s, System: 2286.523 s]

Benchmark 3: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = cbc6318ce8b4b69286f6dfc6c342ad7f319111e7)
  Time (abs ≡):        17461.946 s               [User: 46923.958 s, System: 2267.281 s]

Benchmark 4: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 83aa5806b72ad1e7f433944b01f6afd3006bcec0)

  Time (abs ≡):        17542.543 s               [User: 47258.826 s, System: 2314.857 s]

Benchmark 5: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 830f56fe1fec7396a6fe050f752dd23011ccff0e)
  Time (abs ≡):        16777.022 s               [User: 47664.607 s, System: 2429.423 s]

Benchmark 6: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = fd902d065702b3a6ce0db96765b6e7bf36239488)
  Time (abs ≡):        15616.153 s               [User: 47402.851 s, System: 2452.055 s]

Benchmark 7: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
  Time (abs ≡):        15637.316 s               [User: 47402.667 s, System: 2522.308 s]

Benchmark 8: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
  Time (abs ≡):        15463.250 s               [User: 47511.809 s, System: 2408.478 s]

Benchmark 9: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = a099ad79627487518e561f5788c5759014f45301)
  Time (abs ≡):        15160.517 s               [User: 47023.173 s, System: 2500.516 s]

Relative speed comparison
        1.14          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 8cdc5dd73b73f60113b4b87ac8a1af5de6bc2ea4)
        1.15          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 96523d17f02517dc55c88ecef112a59d0f1269dc)
        1.15          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = cbc6318ce8b4b69286f6dfc6c342ad7f319111e7)
        1.16          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 83aa5806b72ad1e7f433944b01f6afd3006bcec0)
        1.11          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 830f56fe1fec7396a6fe050f752dd23011ccff0e)
        1.03          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = fd902d065702b3a6ce0db96765b6e7bf36239488)
        1.03          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
        1.02          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
        1.00          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = a099ad79627487518e561f5788c5759014f45301)
-----------

for DBCACHE in 4500; do   COMMITS="8cdc5dd73b73f60113b4b87ac8a1af5de6bc2ea4 96523d17f02517dc55c88ecef112a59d0f1269dc cbc6318ce8b4b69286f6dfc6c342ad7f319111e7 83aa5806b72ad1e7f433944b01f6afd3006bcec0 830f56fe1fec7396a6fe050f752dd23011ccff0e fd902d065702b3a6ce0db96765b6e7bf36239488 aa58228e27398b6384bcb8176004ae06419d7e00 080fab38c24b7144edc44724adb8aa570f03c728 a099ad79627487518e561f5788c5759014f45301";   STOP=930039;   BASE_DIR="/mnt/my_storage"; DATA_DIR="$BASE_DIR/BitcoinData"; LOG_DIR="$BASE_DIR/logs";   (echo ""; for c in $COMMITS; do git fetch -q origin $c && git log -1 --pretty='%h %s' $c || exit 1; done) &&   (echo "" && echo "reindex-chainstate | ${STOP} blocks | dbcache ${DBCACHE} | $(hostname) | $(uname -m) | $(lscpu | grep 'Model name' | head -1 | cut -d: -f2 | xargs) | $(nproc) cores | $(free -h | awk '/^Mem:/{print $2}') RAM | SSD"; echo "") &&  hyperfine     --sort command     --runs 1     --export-json "$BASE_DIR/rdx-$(sed -E 's/(\w{8})\w+ ?/\1-/g;s/-$//'<<<"$COMMITS")-$STOP-$DBCACHE-$CC.json"     --parameter-list COMMIT ${COMMITS// /,}     --prepare "killall -9 bitcoind 2>/dev/null; rm -f $DATA_DIR/debug.log; git clean -fxd; git reset --hard {COMMIT} && \
      cmake -B build -G Ninja -DCMAKE_BUILD_TYPE=Release -DENABLE_IPC=OFF && ninja -C build bitcoind -j2 && \
      ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=1000 -printtoconsole=0; sleep 20; rm -f $DATA_DIR/debug.log"     --conclude "killall bitcoind || true; sleep 5; grep -q 'height=0' $DATA_DIR/debug.log && grep -q 'Disabling script verification at block #1' $DATA_DIR/debug.log && grep -q 'height=$STOP' $DATA_DIR/debug.log; \
                cp $DATA_DIR/debug.log $LOG_DIR/debug-{COMMIT}-$(date +%s).log"     "COMPILER=$CC ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=$DBCACHE -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0"; done

8cdc5dd73b validation: fetch inputs on parallel threads
96523d17f0 coins: preserve max load factor during cache reset
cbc6318ce8 max_load_factor{2.0f}
83aa5806b7 max_load_factor{1.75f}
830f56fe1f max_load_factor{1.5f}
fd902d0657 max_load_factor{1.25f}
aa58228e27 max_load_factor{1.0f}
080fab38c2 max_load_factor{0.75f}
a099ad7962 max_load_factor{0.5f}

reindex-chainstate | 930039 blocks | dbcache 4500 | umbrel | x86_64 | Intel(R) N150 | 4 cores | 15Gi RAM | SSD

Benchmark 1: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 8cdc5dd73b73f60113b4b87ac8a1af5de6bc2ea4)
  Time (abs ≡):        21298.395 s               [User: 40044.918 s, System: 3039.879 s]

Benchmark 2: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 96523d17f02517dc55c88ecef112a59d0f1269dc)
  Time (abs ≡):        21881.016 s               [User: 40394.773 s, System: 3471.956 s]

Benchmark 3: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = cbc6318ce8b4b69286f6dfc6c342ad7f319111e7)
  Time (abs ≡):        23238.547 s               [User: 41866.924 s, System: 3397.346 s]

Benchmark 4: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 83aa5806b72ad1e7f433944b01f6afd3006bcec0)
  Time (abs ≡):        22684.086 s               [User: 41393.231 s, System: 3275.538 s]

Benchmark 5: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 830f56fe1fec7396a6fe050f752dd23011ccff0e)
  Time (abs ≡):        22194.048 s               [User: 40999.261 s, System: 3089.280 s]

Benchmark 6: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = fd902d065702b3a6ce0db96765b6e7bf36239488)
  Time (abs ≡):        22305.735 s               [User: 41010.702 s, System: 3462.677 s]

Benchmark 7: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
  Time (abs ≡):        21416.985 s               [User: 40209.055 s, System: 3138.269 s]

Benchmark 8: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
  Time (abs ≡):        21317.316 s               [User: 40330.752 s, System: 3199.684 s]
and

for DBCACHE in 450; do   COMMITS="fd902d065702b3a6ce0db96765b6e7bf36239488 aa58228e27398b6384bcb8176004ae06419d7e00 080fab38c24b7144edc44724adb8aa570f03c728";   STOP=930039;   BASE_DIR="/mnt/my_storage"; DATA_DIR="$BASE_DIR/BitcoinData"; LOG_DIR="$BASE_DIR/logs";   (echo ""; for c in $COMMITS; do git fetch -q origin $c && git log -1 --pretty='%h %s' $c || exit 1; done) &&   (echo "" && echo "reindex-chainstate | ${STOP} blocks | dbcache ${DBCACHE} | $(hostname) | $(uname -m) | $(lscpu | grep 'Model name' | head -1 | cut -d: -f2 | xargs) | $(nproc) cores | $(free -h | awk '/^Mem:/{print $2}') RAM | SSD"; echo "") &&  hyperfine     --sort command     --runs 1     --export-json "$BASE_DIR/rdx-$(sed -E 's/(\w{8})\w+ ?/\1-/g;s/-$//'<<<"$COMMITS")-$STOP-$DBCACHE-$CC.json"     --parameter-list COMMIT ${COMMITS// /,}     --prepare "killall -9 bitcoind 2>/dev/null; rm -f $DATA_DIR/debug.log; git clean -fxd; git reset --hard {COMMIT} && \
      cmake -B build -G Ninja -DCMAKE_BUILD_TYPE=Release -DENABLE_IPC=OFF && ninja -C build bitcoind -j2 && \
      ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=1000 -printtoconsole=0; sleep 20; rm -f $DATA_DIR/debug.log"     --conclude "killall bitcoind || true; sleep 5; grep -q 'height=0' $DATA_DIR/debug.log && grep -q 'Disabling script verification at block #1' $DATA_DIR/debug.log && grep -q 'height=$STOP' $DATA_DIR/debug.log; \
                cp $DATA_DIR/debug.log $LOG_DIR/debug-{COMMIT}-$(date +%s).log"     "COMPILER=$CC ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=$DBCACHE -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0"; done

fd902d0657 max_load_factor{1.25f}
aa58228e27 max_load_factor{1.0f}
080fab38c2 max_load_factor{0.75f}

reindex-chainstate | 930039 blocks | dbcache 450 | i7-hdd | x86_64 | Intel(R) Core(TM) i7-7700 CPU @ 3.60GHz | 8 cores | 62Gi RAM | SSD

Benchmark 1: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = fd902d065702b3a6ce0db96765b6e7bf36239488)
  Time (abs ≡):        38090.837 s               [User: 50575.151 s, System: 3003.521 s]

Benchmark 2: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
  Time (abs ≡):        39555.825 s               [User: 50867.392 s, System: 3041.000 s]

Benchmark 3: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
  Time (abs ≡):        38865.055 s               [User: 50836.020 s, System: 2989.493 s]

Relative speed comparison
        1.00          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = fd902d065702b3a6ce0db96765b6e7bf36239488)
        1.04          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
        1.02          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
and

for DBCACHE in 4500; do   COMMITS="8cdc5dd73b73f60113b4b87ac8a1af5de6bc2ea4 96523d17f02517dc55c88ecef112a59d0f1269dc cbc6318ce8b4b69286f6dfc6c342ad7f319111e7 83aa5806b72ad1e7f433944b01f6afd3006bcec0 830f56fe1fec7396a6fe050f752dd23011ccff0e fd902d065702b3a6ce0db96765b6e7bf36239488 aa58228e27398b6384bcb8176004ae06419d7e00 080fab38c24b7144edc44724adb8aa570f03c728 a099ad79627487518e561f5788c5759014f45301";   STOP=930039;   BASE_DIR="/mnt/my_storage"; DATA_DIR="$BASE_DIR/BitcoinData"; LOG_DIR="$BASE_DIR/logs";   (echo ""; for c in $COMMITS; do git fetch -q origin $c && git log -1 --pretty='%h %s' $c || exit 1; done) &&   (echo "" && echo "reindex-chainstate | ${STOP} blocks | dbcache ${DBCACHE} | $(hostname) | $(uname -m) | $(lscpu | grep 'Model name' | head -1 | cut -d: -f2 | xargs) | $(nproc) cores | $(free -h | awk '/^Mem:/{print $2}') RAM | SSD"; echo "") &&  hyperfine     --sort command     --runs 1     --export-json "$BASE_DIR/rdx-$(sed -E 's/(\w{8})\w+ ?/\1-/g;s/-$//'<<<"$COMMITS")-$STOP-$DBCACHE-$CC.json"     --parameter-list COMMIT ${COMMITS// /,}     --prepare "killall -9 bitcoind 2>/dev/null; rm -f $DATA_DIR/debug.log; git clean -fxd; git reset --hard {COMMIT} && \
      cmake -B build -G Ninja -DCMAKE_BUILD_TYPE=Release -DENABLE_IPC=OFF && ninja -C build bitcoind -j2 && \
      ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=1000 -printtoconsole=0; sleep 20; rm -f $DATA_DIR/debug.log"     --conclude "killall bitcoind || true; sleep 5; grep -q 'height=0' $DATA_DIR/debug.log && grep -q 'Disabling script verification at block #1' $DATA_DIR/debug.log && grep -q 'height=$STOP' $DATA_DIR/debug.log; \
                cp $DATA_DIR/debug.log $LOG_DIR/debug-{COMMIT}-$(date +%s).log"     "COMPILER=$CC ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=$DBCACHE -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0"; done

8cdc5dd73b validation: fetch inputs on parallel threads
96523d17f0 coins: preserve max load factor during cache reset
cbc6318ce8 max_load_factor{2.0f}
83aa5806b7 max_load_factor{1.75f}
830f56fe1f max_load_factor{1.5f}
fd902d0657 max_load_factor{1.25f}
aa58228e27 max_load_factor{1.0f}
080fab38c2 max_load_factor{0.75f}
a099ad7962 max_load_factor{0.5f}

reindex-chainstate | 930039 blocks | dbcache 4500 | umbrel | x86_64 | Intel(R) N150 | 4 cores | 15Gi RAM | SSD

Benchmark 1: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 8cdc5dd73b73f60113b4b87ac8a1af5de6bc2ea4)
  Time (abs ≡):        21298.395 s               [User: 40044.918 s, System: 3039.879 s]

Benchmark 2: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 96523d17f02517dc55c88ecef112a59d0f1269dc)
  Time (abs ≡):        21881.016 s               [User: 40394.773 s, System: 3471.956 s]

Benchmark 3: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = cbc6318ce8b4b69286f6dfc6c342ad7f319111e7)
  Time (abs ≡):        23238.547 s               [User: 41866.924 s, System: 3397.346 s]

Benchmark 4: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 83aa5806b72ad1e7f433944b01f6afd3006bcec0)
  Time (abs ≡):        22684.086 s               [User: 41393.231 s, System: 3275.538 s]

Benchmark 5: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 830f56fe1fec7396a6fe050f752dd23011ccff0e)
  Time (abs ≡):        22194.048 s               [User: 40999.261 s, System: 3089.280 s]

Benchmark 6: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = fd902d065702b3a6ce0db96765b6e7bf36239488)
  Time (abs ≡):        22305.735 s               [User: 41010.702 s, System: 3462.677 s]

Benchmark 7: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
  Time (abs ≡):        21416.985 s               [User: 40209.055 s, System: 3138.269 s]

Benchmark 8: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
  Time (abs ≡):        21317.316 s               [User: 40330.752 s, System: 3199.684 s]

Benchmark 9: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = a099ad79627487518e561f5788c5759014f45301)
  Time (abs ≡):        21184.291 s               [User: 40002.683 s, System: 3512.483 s]

Relative speed comparison
        1.01          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 8cdc5dd73b73f60113b4b87ac8a1af5de6bc2ea4)
        1.03          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 96523d17f02517dc55c88ecef112a59d0f1269dc)
        1.10          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = cbc6318ce8b4b69286f6dfc6c342ad7f319111e7)
        1.07          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 83aa5806b72ad1e7f433944b01f6afd3006bcec0)
        1.05          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 830f56fe1fec7396a6fe050f752dd23011ccff0e)
        1.05          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = fd902d065702b3a6ce0db96765b6e7bf36239488)
        1.01          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
        1.01          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
        1.00          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = a099ad79627487518e561f5788c5759014f45301)
---

for DBCACHE in 450 4500; do   COMMITS="aa58228e27398b6384bcb8176004ae06419d7e00 080fab38c24b7144edc44724adb8aa570f03c728 a099ad79627487518e561f5788c5759014f45301";   STOP=930039;   BASE_DIR="/mnt/my_storage"; DATA_DIR="$BASE_DIR/BitcoinData"; LOG_DIR="$BASE_DIR/logs";   (echo ""; for c in $COMMITS; do git fetch -q origin $c && git log -1 --pretty='%h %s' $c || exit 1; done) &&   (echo "" && echo "reindex-chainstate | ${STOP} blocks | dbcache ${DBCACHE} | $(hostname) | $(uname -m) | $(lscpu | grep 'Model name' | head -1 | cut -d: -f2 | xargs) | $(nproc) cores | $(free -h | awk '/^Mem:/{print $2}') RAM | SSD"; echo "") &&  hyperfine     --sort command     --runs 1     --export-json "$BASE_DIR/rdx-$(sed -E 's/(\w{8})\w+ ?/\1-/g;s/-$//'<<<"$COMMITS")-$STOP-$DBCACHE-$CC.json"     --parameter-list COMMIT ${COMMITS// /,}     --prepare "killall -9 bitcoind 2>/dev/null; rm -f $DATA_DIR/debug.log; git clean -fxd; git reset --hard {COMMIT} && \
      cmake -B build -G Ninja -DCMAKE_BUILD_TYPE=Release -DENABLE_IPC=OFF && ninja -C build bitcoind -j2 && \
      ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=1000 -printtoconsole=0; sleep 20; rm -f $DATA_DIR/debug.log"     --conclude "killall bitcoind || true; sleep 5; grep -q 'height=0' $DATA_DIR/debug.log && grep -q 'Disabling script verification at block #1' $DATA_DIR/debug.log && grep -q 'height=$STOP' $DATA_DIR/debug.log; \
                cp $DATA_DIR/debug.log $LOG_DIR/debug-{COMMIT}-$(date +%s).log"     "COMPILER=$CC ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=$DBCACHE -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0"; done

aa58228e27 max_load_factor{1.0f}
080fab38c2 max_load_factor{0.75f}
a099ad7962 max_load_factor{0.5f}

reindex-chainstate | 930039 blocks | dbcache 450 | i9-ssd | x86_64 | Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz | 16 cores | 62Gi RAM | SSD

Benchmark 1: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
  Time (abs ≡):        15703.200 s               [User: 47638.177 s, System: 2527.972 s]

Benchmark 2: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
  Time (abs ≡):        15508.249 s               [User: 47239.333 s, System: 2448.704 s]

Benchmark 3: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = a099ad79627487518e561f5788c5759014f45301)
  Time (abs ≡):        15197.077 s               [User: 46910.014 s, System: 2400.646 s]

Relative speed comparison
        1.03          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
        1.02          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
        1.00          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = a099ad79627487518e561f5788c5759014f45301)

aa58228e27 max_load_factor{1.0f}
080fab38c2 max_load_factor{0.75f}
a099ad7962 max_load_factor{0.5f}

reindex-chainstate | 930039 blocks | dbcache 4500 | i9-ssd | x86_64 | Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz | 16 cores | 62Gi RAM | SSD

Benchmark 1: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
  Time (abs ≡):        14433.489 s               [User: 33394.391 s, System: 1048.727 s]

Benchmark 2: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
  Time (abs ≡):        14271.466 s               [User: 33312.939 s, System: 1037.455 s]

Benchmark 3: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = a099ad79627
  Time (abs ≡):        14031.298 s               [User: 33129.949 s, System: 1047.214 s]

Relative speed comparison
        1.03          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
        1.02          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
        1.00          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = a099ad79627487518e561f5788c5759014f45301)
----

or DBCACHE in 450; do   COMMITS="8cdc5dd73b73f60113b4b87ac8a1af5de6bc2ea4 96523d17f02517dc55c88ecef112a59d0f1269dc cbc6318ce8b4b69286f6dfc6c342ad7f319111e7 83aa5806b72ad1e7f433944b01f6afd3006bcec0 830f56fe1fec7396a6fe050f752dd23011ccff0e fd902d065702b3a6ce0db96765b6e7bf36239488 aa58228e27398b6384bcb8176004ae06419d7e00 080fab38c24b7144edc44724adb8aa570f03c728 a099ad79627487518e561f5788c5759014f45301";   STOP=930039;   BASE_DIR="/mnt/my_storage"; DATA_DIR="$BASE_DIR/BitcoinData"; LOG_DIR="$BASE_DIR/logs";   (echo ""; for c in $COMMITS; do git fetch -q origin $c && git log -1 --pretty='%h %s' $c || exit 1; done) &&   (echo "" && echo "reindex-chainstate | ${STOP} blocks | dbcache ${DBCACHE} | $(hostname) | $(uname -m) | $(lscpu | grep 'Model name' | head -1 | cut -d: -f2 | xargs) | $(nproc) cores | $(free -h | awk '/^Mem:/{print $2}') RAM | SSD"; echo "") &&  hyperfine     --sort command     --runs 1     --export-json "$BASE_DIR/rdx-$(sed -E 's/(\w{8})\w+ ?/\1-/g;s/-$//'<<<"$COMMITS")-$STOP-$DBCACHE-$CC.json"     --parameter-list COMMIT ${COMMITS// /,}     --prepare "killall -9 bitcoind 2>/dev/null; rm -f $DATA_DIR/debug.log; git clean -fxd; git reset --hard {COMMIT} && \
      cmake -B build -G Ninja -DCMAKE_BUILD_TYPE=Release -DENABLE_IPC=OFF && ninja -C build bitcoind -j2 && \
      ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=1000 -printtoconsole=0; sleep 20; rm -f $DATA_DIR/debug.log"     --conclude "killall bitcoind || true; sleep 5; grep -q 'height=0' $DATA_DIR/debug.log && grep -q 'Disabling script verification at block #1' $DATA_DIR/debug.log && grep -q 'height=$STOP' $DATA_DIR/debug.log; \
                cp $DATA_DIR/debug.log $LOG_DIR/debug-{COMMIT}-$(date +%s).log"     "COMPILER=$CC ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=$DBCACHE -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0"; done

8cdc5dd73b validation: fetch inputs on parallel threads
96523d17f0 coins: preserve max load factor during cache reset
cbc6318ce8 max_load_factor{2.0f}
83aa5806b7 max_load_factor{1.75f}
830f56fe1f max_load_factor{1.5f}
fd902d0657 max_load_factor{1.25f}
aa58228e27 max_load_factor{1.0f}
080fab38c2 max_load_factor{0.75f}
a099ad7962 max_load_factor{0.5f}

reindex-chainstate | 930039 blocks | dbcache 450 | rpi5-16-3 | aarch64 | Cortex-A76 | 4 cores | 15Gi RAM | SSD

Benchmark 1: COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 8cdc5dd73b73f60113b4b87ac8a1af5de6bc2ea4)
  Time (abs ≡):        33166.734 s               [User: 82523.048 s, System: 6475.929 s]

Benchmark 2: COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 96523d17f02517dc55c88ecef112a59d0f1269dc)
  Time (abs ≡):        33107.144 s               [User: 82407.084 s, System: 6616.901 s]

Benchmark 3: COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = cbc6318ce8b4b69286f6dfc6c342ad7f319111e7)
  Time (abs ≡):        33057.577 s               [User: 81896.723 s, System: 6302.222 s]

Benchmark 4: COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 83aa5806b72ad1e7f433944b01f6afd3006bcec0)
  Time (abs ≡):        33996.683 s               [User: 83513.642 s, System: 6638.377 s]

Benchmark 5: COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 830f56fe1fec7396a6fe050f752dd23011ccff0e)
  Time (abs ≡):        33698.289 s               [User: 83591.636 s, System: 6378.166 s]

Benchmark 6: COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = fd902d065702b3a6ce0db96765b6e7bf36239488)
  Time (abs ≡):        33212.456 s               [User: 82321.317 s, System: 6533.662 s]

Benchmark 7: COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
  Time (abs ≡):        33859.466 s               [User: 84108.022 s, System: 6715.665 s]

Benchmark 8: COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
  Time (abs ≡):        32846.268 s               [User: 82035.391 s, System: 6500.530 s]

Benchmark 9: COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = a099ad79627487518e561f5788c5759014f45301)
  Time (abs ≡):        32946.326 s               [User: 82332.716 s, System: 6725.863 s]

Relative speed comparison
        1.01          COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 8cdc5dd73b73f60113b4b87ac8a1af5de6bc2ea4)
        1.01          COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 96523d17f02517dc55c88ecef112a59d0f1269dc)
        1.01          COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = cbc6318ce8b4b69286f6dfc6c342ad7f319111e7)
        1.04          COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 83aa5806b72ad1e7f433944b01f6afd3006bcec0)
        1.03          COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 830f56fe1fec7396a6fe050f752dd23011ccff0e)
        1.01          COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = fd902d065702b3a6ce0db96765b6e7bf36239488)
        1.03          COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
        1.00          COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
        1.00          COMPILER= ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = a099ad79627487518e561f5788c5759014f45301)
---------

for DBCACHE in 4500; do \
  COMMITS="fd902d065702b3a6ce0db96765b6e7bf36239488 aa58228e27398b6384bcb8176004ae06419d7e00 080fab38c24b7144edc44724adb8aa570f03c728"; \
  STOP=930039; \
  BASE_DIR="/mnt/my_storage"; DATA_DIR="$BASE_DIR/BitcoinData"; LOG_DIR="$BASE_DIR/logs"; \
  (echo ""; for c in $COMMITS; do git fetch -q origin $c && git log -1 --pretty='%h %s' $c || exit 1; done) && \
  (echo "" && echo "reindex-chainstate | ${STOP} blocks | dbcache ${DBCACHE} | $(hostname) | $(uname -m) | $(lscpu | grep 'Model name' | head -1 | cut -d: -f2 | xargs) | $(nproc) cores | $(free -h | awk '/^Mem:/{print $2}') RAM | SSD"; echo "") &&\
  hyperfine \
    --sort command \
    --runs 1 \
    --export-json "$BASE_DIR/rdx-$(sed -E 's/(\w{8})\w+ ?/\1-/g;s/-$//'<<<"$COMMITS")-$STOP-$DBCACHE-$CC.json" \
    --parameter-list COMMIT ${COMMITS// /,} \
    --prepare "killall -9 bitcoind 2>/dev/null; rm -f $DATA_DIR/debug.log; git clean -fxd; git reset --hard {COMMIT} && \
      cmake -B build -G Ninja -DCMAKE_BUILD_TYPE=Release -DENABLE_IPC=OFF && ninja -C build bitcoind -j2 && \
      ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=1000 -printtoconsole=0; sleep 20; rm -f $DATA_DIR/debug.log" \
    --conclude "killall bitcoind || true; sleep 5; grep -q 'height=0' $DATA_DIR/debug.log && grep -q 'Disabling script verification at block #1' $DATA_DIR/debug.log && grep -q 'height=$STOP' $DATA_DIR/debug.log; \
                cp $DATA_DIR/debug.log $LOG_DIR/debug-{COMMIT}-$(date +%s).log" \
    "COMPILER=$CC ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=$DBCACHE -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0";
done

fd902d0657 max_load_factor{1.25f}
aa58228e27 max_load_factor{1.0f}
080fab38c2 max_load_factor{0.75f}

reindex-chainstate | 930039 blocks | dbcache 4500 | i7-hdd | x86_64 | Intel(R) Core(TM) i7-7700 CPU @ 3.60GHz | 8 cores | 62Gi RAM | SSD

Benchmark 1: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = fd902d065702b3a6ce0db96765b6e7bf36239488)
  Time (abs ≡):        27250.633 s               [User: 35171.227 s, System: 1136.702 s]

Benchmark 2: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
  Time (abs ≡):        28430.202 s               [User: 34969.789 s, System: 1121.994 s]

Benchmark 3: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
  Time (abs ≡):        27280.423 s               [User: 34929.023 s, System: 1133.422 s]

Relative speed comparison
        1.00          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = fd902d065702b3a6ce0db96765b6e7bf36239488)
        1.04          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
        1.00          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=4500 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
root@i7-hdd /mnt/my_storage/bitcoin # for DBCACHE in 450; do   COMMITS="fd902d065702b3a6ce0db96765b6e7bf36239488 aa58228e27398b6384bcb8176004ae06419d7e00 080fab38c24b7144edc44724adb8aa570f03c728";   STOP=930039;   BASE_DIR="/mnt/my_storage"; DATA_DIR="$BASE_DIR/BitcoinData"; LOG_DIR="$BASE_DIR/logs";   (echo ""; for c in $COMMITS; do git fetch -q origin $c && git log -1 --pretty='%h %s' $c || exit 1; done) &&   (echo "" && echo "reindex-chainstate | ${STOP} blocks | dbcache ${DBCACHE} | $(hostname) | $(uname -m) | $(lscpu | grep 'Model name' | head -1 | cut -d: -f2 | xargs) | $(nproc) cores | $(free -h | awk '/^Mem:/{print $2}') RAM | SSD"; echo "") &&  hyperfine     --sort command     --runs 1     --export-json "$BASE_DIR/rdx-$(sed -E 's/(\w{8})\w+ ?/\1-/g;s/-$//'<<<"$COMMITS")-$STOP-$DBCACHE-$CC.json"     --parameter-list COMMIT ${COMMITS// /,}     --prepare "killall -9 bitcoind 2>/dev/null; rm -f $DATA_DIR/debug.log; git clean -fxd; git reset --hard {COMMIT} && \
      cmake -B build -G Ninja -DCMAKE_BUILD_TYPE=Release -DENABLE_IPC=OFF && ninja -C build bitcoind -j2 && \
      ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=1000 -printtoconsole=0; sleep 20; rm -f $DATA_DIR/debug.log"     --conclude "killall bitcoind || true; sleep 5; grep -q 'height=0' $DATA_DIR/debug.log && grep -q 'Disabling script verification at block #1' $DATA_DIR/debug.log && grep -q 'height=$STOP' $DATA_DIR/debug.log; \
                cp $DATA_DIR/debug.log $LOG_DIR/debug-{COMMIT}-$(date +%s).log"     "COMPILER=$CC ./build/bin/bitcoind -datadir=$DATA_DIR -stopatheight=$STOP -dbcache=$DBCACHE -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0"; done

fd902d0657 max_load_factor{1.25f}
aa58228e27 max_load_factor{1.0f}
080fab38c2 max_load_factor{0.75f}

reindex-chainstate | 930039 blocks | dbcache 450 | i7-hdd | x86_64 | Intel(R) Core(TM) i7-7700 CPU @ 3.60GHz | 8 cores | 62Gi RAM | SSD

Benchmark 1: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = fd902d065702b3a6ce0db96765b6e7bf36239488)
  Time (abs ≡):        38090.837 s               [User: 50575.151 s, System: 3003.521 s]

Benchmark 2: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
  Time (abs ≡):        39555.825 s               [User: 50867.392 s, System: 3041.000 s]

Benchmark 3: COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)
  Time (abs ≡):        38865.055 s               [User: 50836.020 s, System: 2989.493 s]

Relative speed comparison
        1.00          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = fd902d065702b3a6ce0db96765b6e7bf36239488)
        1.04          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = aa58228e27398b6384bcb8176004ae06419d7e00)
        1.02          COMPILER=gcc ./build/bin/bitcoind -datadir=/mnt/my_storage/BitcoinData -stopatheight=930039 -dbcache=450 -reindex-chainstate -blocksonly -connect=0 -printtoconsole=0 (COMMIT = 080fab38c24b7144edc44724adb8aa570f03c728)

@l0rinc l0rinc force-pushed the detached138 branch 2 times, most recently from a70b5de to 443255d Compare December 27, 2025 07:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants